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study Skills Assessment 

Abstract 

A 30-iteTi Study Skills Que/ 'onna ire (SSQUES),. designed to evaluate 
studihts' perceptions of tht.' s:udy skills in thi areas of reading 
comprehension, meroorizatton, test taking, and concentration management, 
was subjected to a preliminary reliability and validity study in the 
context of -the Air Force Advanced Instructional System. For apprdxl- 

'4 . 

mately nine weeks, students in four computer-managed instruction courses 
Were assigned the SSQUES following their first course block. The ques- 
}tiohnaire danonstrated substantial reliability and construct validity, 
and predictive validity results supported the power of this measure to 
predict student achievement and to discriminate between students who 
would perform well versus poorly. 
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AltHbugh student study skills appear to be logically related to 
academic performance and some studies confirm this relationship (e/g.. 
Brown, 1964; Brown & Holtzman, 1966, 1967; Desiderato % Koskinen, 1969^ 
Miller & Michael, 1972), other studies either find no relationship (e.g.. 
Bbddeh, Osterhouse^ 5 Gelsd, 1972; Hartley, 1966; McCausland S Stewart, 
1974) or find a relationship for only specific types of students (e.g.. 
Wen S Liu, 1976). The question is raised, therefore, cohcerhing the ade- 
quacy of existing study skills measures for predicting student perfbrmahce 
in the instructional envirdrtment. 

Existing ihstranerits that are frequently used to measure student study 
skills are the Brown-Holtzman (1966) Survey of Study Habits arid Attitudes 
(SSHA) and the Study Attitudes and Methods Survey (SAMS; Michael, Michael, S 
Zintnermah^ 1972). These instruments were not only validated in conventional 
group-paced iristructidrial settings, but have been used almost exclusively in 
such environments (e.g.* Greiher S Karbly, 1976; Jacksdri S Vari Zddst, 1974; 
Light & Alexakos, 1970; Miller S MichaeT, 1972). A further question can be 
raised, then, about the usefulness of these existing study skills measures 
for predicting student performarice in the expanding number of innovative 
instructional erivironmehts which are applying recent develdpmehts in ins true 
tional technology to the classroom. Fbr example, bperi classrooms, ability 
tracking, and various forms of self-pacing and individualized, computer- 
based iristructidrial apprdaches are becoming more and more prevalent. 

9ne example bf advanced computer-based instructional technology applied 
to large scale training is the Air Force Advanced Iristructidrial System (AIS) 
The AIS is a large scale computer-based training systen in which students 
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in one of four technical training specialties learn their respective course 
materials via self-paced^ individualized, and c^niputer-nanaged instruction. 
Within this system^ students progress at a rate detsnnirr^ by their 
individual skills, abilities, and interests. 

The self-paced envirdnrnent within the AIS hecessit^^tes that students 
take responsibility for their om learning, and that they know how to 
study effectively. Poor or inadequate study skills, however, characterizes 
a large nwnber of AIS students. Furthermore, until various forms of 
individualized instruction becditie cdirindh in bur public school system^ few 
students will know how to transition their passive learning behaviors to 
the active information processing strategies and skills required for self- 
directed liearning. Thus, AIS instructor personnel have found that the 
diagnosis and remediation of student study skills deficiencies is both 
critical to successful course cdrapletion by students and critical to their 
own role as counselor and tutor of students in the AIS environment. 

Given the AIS environment and the critical ity of effective student 
study skills In that; environment* along with the problems with existing 
study skills measures * a new instrument was developed in the context of 
the AIS. This instrument was developed for use by either instructor 
personnel or computer-based adaptive decision models in the identification 
and diagnosis of students in need of specific study skills remediation. 
This measure differs from other cbrnnbhly used measures in tts use of both 
(a) comparative self-ratings of perceived academic abilities and effective 
study skills relative to other students and (b) forced-choice descriptions 
of specific study skills and behaviors. As suggested by a number of 
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researchers (e.g.i Bbrnsteini Hamilton. Miller, Quevillbri & Spitzferra* 1977; 

^ 

Centra, 1977; Soldried I O'Zurilla, 1973; Hisehel. 1968), comparative self- 
ratings can be a particularly valid and predictive method for assessing 
student characteristics and behaviors. Thus, it was hypothesized that 
using ebmparative self-ratings in conjunction with tha students' description 
of their study habits and skills would result in a measure that wbald be 
predictive of (a) student perfonnarice bri AIS cburse materials (times-to- 
complete, criteribh test scbres) and (b) those students in need of study 
skills remediation. 

The present paper reports the results of preniriinary reliability and 
validity data on this new instrument, the Student Study Skills Questionnaire 
(SSQUES). the context for the evaluatibh was the four technical training 
Cburses supported by the AIS. 
■\ Method 

Subjects . Subjects were raale and female Air Force trsfnees enrolled 
in the imentory Hariagemeht (IM), Materiel Facilities (MF), Precision 
Measuring Equipment (PME), and Weapons Mechanic (WM) courses during the 
period from July 1978 through September 1978. During this evaluatibri 
period, the number of students available for reliability and validity 
analyses were 313 in the I H cburses 92 in the MF course, 79 in the PME 
course i and 297 in the WM course. Students were excluded from analysis 
if they failed to have reliable data on both the pridietor and criterion 
variables. Student ages ranged from 17 to 41 years (mean = 21.5 years). 

■ Measures . The initial SSQUES was cbmpbsed bf 56 multiple choice items 
i*ich asked students to evaluate their skills in each of four areas: 

ERIC ^ 
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Reading Comprehension (READCM), Memorization (MEMORY), Concentration 
Management (CdNMGT), and Test Taking (TSTTAK). There were 15 READCM 
items* 12 f€HORY and H CONMGT items, arid 11 TSTTAK items. Following a 
preliminary small group trybut to assess the questionnaire's internal 
consistency, 26 of the original 50 items which consistently demonstrated 
low item remainder correlations with the total scale or appropriate sub- 
scales wer^. dropped, the resiiltirig 30-item SSQUES used iri the reported 
reliability arid validity analyses contairied eight REABCM fteFns, seven 
MEMSRY items, nine CONMGT items, and six TSTTAK items. A copy of the 
3d-item SSQUES and its subscales is shown ifi table 1. Student directioris* 
printed dri the SSQUES were: "A riinber of statemerits which students have 
used to describe their study habits arid sIcilTs are giveri belbwi Please 
read each stateireht carefully and then blacken the space on your answer 
sheet which best describes your study habits and skills. There are no 
right or wrong answers. Do not spend too much tiifie dri arty drie staten^rit* 
but select the ariswer which best describes your study habits arid skills. 
Notice that you are asked to describe your study skills in four basic 
areas (reading comprehension, memorization, .test-taking, concentration 
management)." 



Insert table 1 about here 

the criterion variables of interest in this studly were times-to- 
complete arid criterion test scores bri selected blocks arid lessbris iri the 
IM, MF, PME, and HM courses. 
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Procedure . The SSOUES was placed in each of the four AIS course 
hierarchies such that it was the first assignment students received after 
suceessfuny completing the first block of their respective coarse. 
Buring this evaluation period of approximately nine weeks, reliability 
data for the SSQUES and its subseales were collected by the AIS software 
for subsequent analysis by the AIS Test Item Evaluation program. Similarly, 
validity data were atttomatically collected by the AIS software for subsequent 
analysis by the AIS Data Analysis Systen. This data analysis capability 
provided an interface with standard statistical packages. 

Results ■ 

Questibrinaire Rel i a bility Restf Tts . The means* standard deviations, 
and alpha reliability coefficients for the 30-item SSqUES and its four 
subseales are reported in Table 2 for all four AIS courses. The AlS Test 
Item Evaluation (TIE) program was used in the calculation of all relia- 
bility results. 



Insert Table 2 about here 

As Table 2 indicates, the alpha reliabilities of the SSQUES ranged 
from a low of .81 to a high of .95, indicating high internal cohsisteheies 
for the total questionnaire across the four AIS courses. It should be 
noted that only in the WM course did the alpha reliability of the total 
scale drop below .90. The reliability data reported in Table 2 also 
indicate that (a) the alpha reliability of the READCM subscale ranged 
from a low of .58 to a high of .87; (b) the MEMORY subscale reliability 
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ranged from a low of ,35 to a High of .75; (e) the alpha reliability of 
the TSTTAK subscale ranged from a low of .48 to a high of .84; and (d) 
the CONMGT subscale alpha reliability ranged from a low of .82 to a high 
of .38. Again ^ reliability coefficients from the WM course tended to 
be lower on all subscales than the other AIS courses, although the GQNMGT 
subscale demonstrated consistently high reliability across all four AIS 
courses. One possible explanation for the lower reliability coefficients 
in the WM course data may be the generally lowdr variability in these 
data. 

Item-remainder ebrrelatibhs of the individual SSQOES items, with bath 
the total scale and the appropriate subscale, were determined separately 
for each AIS course. Tables 3 through 6 present the means, standard 
deviations and iteltn remainder cdrrelatidns for the individual items for 
data from the IM^ HF^ PRE and HH courses* respectively. 



Insert Tables 3 through 6 about here 



As indicated in Tables 3 through 5, five items demonstrated consis- 
tently low item remainder correlations with their appropriate subscales 
across the four AIS courses. These items are: (a) Item 5 on the READCM 
scale; (b) Items 9, 12 and 14 on the MEMORY scale; and (c) ItOT 18 on 
the TSTTAK scale. ^ These items are thus candidates for subsequent revision 
to increase the overall reliability of the SSQUES and its sabscaleSi 

Questionnaire ValKlity Results. The validity of the SSQUES was 
assessed in two ways. F^rst^ its construct validity was addressed by 
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detenniriirig the extent to which the questionnaire and its subscales demon- 
strated moderately high intercorrelations and consistent cdhceptual 
groupings across the four AIS courses, these eohstruct validity 
questions were assessed by correlatibhal and factor analyses, respectively. 
Second^ its predictive validity was addressed by determining the extent 
to which the questionnaire and its subscales were predictive of student 
performance, in general, and of the performance of particular subgroups. 
These questions were assessed by regression and discrimihaht analyses, 
respectively. Routines from the Statistical Package for the Social 
Sciences (SPSS; Nie, Hull , Jenkins, Steinbrenner, and Bent, 1975) were 
utilized in the foregoing analyses. 

Construct Validity. As evidence of the construct validity of the 
SSQUES and its READGH, flEMSRY, fsTTAK, and egNMST subscales, inter- 
cbrrelation matrices were calculated separately for student data on these 
measures from each of the four AIS courses. These matrices are shown 
in Tables 7 through 10 for the IM* MF; PHE and HH courses, respectively, 
the results generally indicate moderate to moderately high intercorrelations 
between the SSQUES and its subscales, suggesting that the four subscales 
of the SSQUES are within the same student characterfstic variable ddmaih. 



Insert Tables 7 through 10 about here 



A further examination of the Questionnaire's construct validity was 
cohducted via factor analyses. ef IH and l?H course data^ 8nly these two 
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courses had sample sizes considered adequate for this statistical method- 
ology. Data from the SSQUES arid four subseales wer^ combined with student 
data on the set of affective and ebgm'tive preassessmeht variables assessed 
at the beginning of the courses. Descriptions of the variables iricluded 
in the IM preassessnent battery are given in Table 11, along with the 
appropriate variable labels, the results of the IM fagtbr analysis are 
shovni in table 12. As can be seen i the study skills variables formed a 
separate factor following the Varimax rotation procedure. Six definable 
factors were derived from the preassessment and study skills variables^ 
with the variables from the Study Skills questionnaire loading oh the 
third factor. Of interest for the construct validity question is that (a) 
the READGiM scale tended to load positively on the Reading/Reasoning, 
Curiosity , and Media Experience factors; (b) the MEMORY scale tended to 
load positively on the Reading/ReasOhihg feetor; (c) the TSTTAK scale 
tended to load negatively bh the Anxiety factor and positively on the 
Readihg/Reasbnihg factor; (d) the CONflGT scale tended to load negatively 
bh the Anxiety factor and positively on the Curiosity factor; arid (e) the 
SSQUES total scale tended tb load negatively bh the Anxiety factor and 
positively bh the Readirig/Reasbhirig factbr-i 



Insert Tables V and 12 about here 



Discriptibhs of the variables included bh the WM preassessmeht battery 
are given in Table 13, together with the appropriate variable labels. The 
factor analysis results from the WH course* shown in table 14* are similar 
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to those found in the IM course. Seven definable factors were derived from 
the Wfl preassessmeht and study skill variable set^ with SSQUES variables 
loading on the second factor. Other findings of interest were that (a) 
the READeM scale tended to load negatively on the Anxiety factor and 
positively on the Curiosity factor; (b) the MEMORY scale tended to load 
negatively on the Anxiety factor and positively on the multiple Media 
Preference factor; (c) the TSTTAK scale tended to load negatively on the 
Anxiety factor; (d) the CONMGT scale tended to load negatively on the 
multiple Media Preference. factor and positively bh the Guribsity factor; 
and (e) the SSQUES tbtal scale tended to load negatively oh the Anxiety 
factor and on the multiple Media Preference factor. 



Insert Tables 13 and 14 about here 



Predictive Validity . The question of whether the SSQUES and its sub- 
scales could reliably predict student performance In the four AIS courses 
was examined by regression and discriminaht analysis approaches. In the 
fegressidh analyses* the multiple stepwise raethodbldgy was utilized to 
predict both (a) coarse completion times and totcl block scores for those 
Mis courses with adequate samples (i.e., the IM and MF eburses); and (b) 
individual block times and scores for the IM, MF^ and m eburses. utilizing 
the SSQUES and its four subscales (READEM, MEMORY, TSTTAK. CdNMGT) as pre- 
dictors, (The nunber of cases for the PME course blocks was less than 25 
per block and thus considered too small for the regressibh methbdblbgyi ) 
The results of the first set bf regressibh analyses are shown in Table 15 



_ . study Skills Assessment 

■ " ' lb 
for the IH arid HF courses; the results of the second set df regressidri 
arialyses are shown in 'Table 16 for the IM arid MF courses, and iri Table 17 
for the wH course. • . • 



;^ Insert tables 15, le, 17 about here 



As shown in table 15* IH course completion time (Blocks 2 thrpugh-er'' 
was reliably predicted by the MEMORY arid CONMGt seal es 'wi tf an of .40. 
the sum of the block scores for IM course Blocks 2 through 6 was reliably 
predicted by the READCM, TSTTAKj arid COflMGt scales with an R^ of .14. The 
, results from the MF course iridicated that the MEMORY scale reliably pre- 
dicted course cdmpletlbri time for Blocks 2 through 5 with an of .15. 
the son of MF course block scores for Blocks 2 through 5 was predicted by 
. _ the TSTTAk and READCM scales with ari R^ of .26. 

tables 16 arid 17 iridicate variable firidirigs regarding the effectiveriess 
of the study skills variables in predicting individual block times (BEtA 
variables) arid scores (BSCR variables) in the three AIS courses. Iri the 
IM course, the MEMORY, SSQUES, arid CONHGt variables appeared to do the best 
job in predictirig block completibri times, accouritirig for betweeri 13 arid 35 
percent of the variarice (R^j. Ori the other harid, the tSttAK, CONMGt, and 
REAOeM variables appeared to do the best 30b of jiredicting IM course block 
scores, with R^s ranging betweeri .04 arid .13. the MF results iridicated 

that the MEMORY* TSttAK* and GONMST variables best predicted block times 

2 ■ - - - ■ ^ 

(R's bet»#een .03 and .14), and the TSttAK, READCM, and CONHGT variables 

>- • 2 " 

best predicted block scores (R s tetween .08 and .26). In the WM coursei ;. 

iq' - 

o ■ 
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the eUNHSf variable appeared to be the best predictor of individual block 

timesi with the other study skills variables sdmetirnes entering the pre- 

__ ___ __ _ 2 ' 

diction, and with the R s ranging between ^93 and .13. The best predictors 
of individual block scores in the WM course were the MEMORY and CONMGT 
variables, accounting for between five and 19 percent of the variance (R^). 

The purpose of the second category of predictive validity analyses 
was to determine if the various study skills variables could reliably dis- 
tinguish students in the least efficient and least effective quartiles, on 
the block and lesson cbmpletioh time and score criterion variables, from 
those remaining 75 percent of the students who were having less difficulty 
completing the course quickly and successfully. These analyses were 
restricted to th^ IH and WM' courses since these courses had the largest 
numbers of student samples available on the SSQUES administered at the end 
:of the first block. 

In the IM course i block level data .considered appropriate for dis- 
criniihaht analyses were block cbmpletioh times oh Blocks 2 through 5, block 
test failures oh ah early (Block 2) and a late (Block 5) block, and block - 
test scores oh these same, two blocks. In addition^ cumulative lesson 
completion times arid average lesson test scores were examined for these two 
blocks. 

Results of the discrimihaht analyses oh the IM block level data are 
reported in Table 18. The results indicated that the study skills variables 
were moderately effective in discriminating slow from fast students^ 
correctly classifying between 61.3 and 69.8 percent of the students^ with 
a slight gain in predictability from the early to later Blocks. When 
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completion times across the four blocks were siiinmedi the scales were quite 
effective in reliably discrimihatihg the slowest quarter of the students 
from the rernaihihg students^ correctly classifying 67.8 percent of the 
students. 



Insert Table 13 about here 



With respect to number of block test failures, the scales were 
moderately effective in discriminating students with dile or more block test 
failures from those who passed the block tests oh the first attempt. In 
this case* predictability actually improved somewhat from the second (58.2 
percent correctly classified) to the fifth (61.8 percent correctly class- 
ified) block. 

Finally, it was considered of interest to determihe the scales* power 
to discriminate the bottom quarter of the block test score distribution from 
the remaining 75_percent. Again, the scales were found to be quite 
effective in discriminating between these two groups and, again, predict^ 
ability was found to improve slightly from the second to the fifth block 
(63.0 versus 54.3 percent correctly classified). When Block 2 through 5 
scores were Sttirted and the lowest 25 percent discriminated from the 
remaining 75 percent, 65.1 percent of the students were correctly classified. 

In general* these results indicate that the HEHORY* SSQUES and GEiNPIGf 
scales appeared to be most effective in predicting block times. 9n the 
other hand, the SSQUES, MEi«RY and TSTTAK scales, appeared to be most 
effective in predicting block failures and test scores. 
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Results of the lesson level discriminant analyses on the early (Block 
2) and late (Block 5) blocks of the IM course are shown in fable 19. Agaihi 
it should be noted that the analyses discriminated the perfonnahce of the 
bottom 25 percent of the students from the reraainihg 75 percent with 
respect to lasson completidh times and scores. The cutoff values shown 
refer to cumulative lesson completion times and average first attempt lesson 
test scores for all of the lessons withiS-^each of the blocks, fhe-study 
skills scales were found to be moderately effective in reliably dis- 
crimihatihg befa*eeh these two groups on both the time and score dimensions, 
with the percent of students correctly classified ranging from 61.2 to 66.1 
percent. It Is important to note that there was to great loss (apparently r 
ih fact* a slight gain for the time variable) in predictability from the 
early to the later block. The TSTTAK and SSQUES total 5cal6^ were most 
effective in discriminating between groups on the.time air«nS;iont while 
TSTTAK and COnMgT scales appeared to do the best 3db ih discriraihatihg 
between groups with respect to lesson scores. 



Insert Table 19 about here 
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In the WM course* which consisted of 14 blocks^ the hunben of cases 
available in the later blocks was consistently less than 100 per block, 
which would imply Jarge instability in parameter estimation, therefore, the 
block level data considered apprdpriate for analysis in the W! course con- 
sisted of block completidh times for Blocks 2 through 8^ block test failures 
oh an early (Block 2) and a relatively late (Block 8) block, and block test 
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'Scores on these same blocks. Cumulative lesson completion times arid 
average lesson test scores were a i so examined for these too blocks. 

Results of the discriminant analyses for the WM block level data are 
reported in fable 29. Tlie' same procedures were followed as for the IH 
course analyses. The results indicated that the study skills variables 
were moderately effective in discriminating inefficient (lowest 25 percent) 
from efficient (reraairiihg 75 percent) students with respect to individual 
block completion times. Excluding Blocks 3 and 7, (in which the Chi Square 
values Were not siinificant at the p < .05 :ieVel)V between 51.8 and 75.7 
percent of the students were correctly classified. Hhen completion times 
were suimed across the seVeh blocks* the scales were quite effective in 
reliably discriminating the slowest quarter of the students from the 
raiaihing 75 perient; correctly classifying 68.9 percent of the students. 



Insert Table 20 about here 



In Blocks 2 and 8. the scales were highly effective in diserimihatihg 
, students with one or more block test failures from those who passed the 
block tests on the first attempt, fe had been the case for the IM course, 
predictability actually increased from the earlier (Block 2, 68.3 percent 
correctly classified) to the later (Block 8, 71.9 percent correctly class- 
ified) blocks. 

The four study skills scales were only fairly effective in discrlmin- 
atiiq the lowest quarter of the students from the remaining 75% with respect 
to the block test score distribution, with 56.8 percent of the students 
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. classified in Blbek 2 (Ehi-Square not significant at p <.05), and'59.6 
percent correctly classified in Block 8. Mhen Block 2 through 8 Scores 
were sunned, however, the discriminate results were much improved. With 
69.3 percent of the students correctly classified. 

In general* it appears that the SSqUES total scale was most effective 
- in predicting block completion times, while the READCM and TSHAK scales 
were most effective in predicting block test failures and scores. 

Results of the lesson level discrimihaht analyses on the early (Block 
2) and late (Block 8) portions of the WM course are presented in Table 21. 
As was the ease for the IM lesson level analyses, the two student categories 
defined on each (time and score) dimension were those considered to be dis- 
playing unsatisfactory (bottom 25 percent) or satisfactory (remaining 75 
percent) peffdrmahce. Again* the cutoff values shown pertain to cunulative 
lesson cbmpletibh times across all lessons in the block and average first 
attempt lesson test scores for all lessons having cognitive criterion 
tests. The study skills scales were modefately effective in discriminating 
between the two groups in terms of time (61.0 and 63.2 percent correctly 
cla^sifiedli but less effective in discrimijiatihg between groups on the 
score dimension (54.8 and 57.9 percent correctly classified). Once again* 
there is a consistent pattern of increasin^lsredictability from the earlier 
to the later block. The SSQUES total and fSTTAK scales appeared to be the 
most effective in discrimj hating students categi)ri:7ed into the Low Group 
from those in the High Group, with SSQUES being more effective on the time 
dimension and TSTTAK being, more effective bh the score diniehsiehi 
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Insert Table 21 about here 



Finally, of interest in assessing the predictive validity of the 
SSQUES and its subscales was the question of the relative power of these 
variables to discriminate the poorest quarter of students bri the lesson 
and block tiine and score dimensions from the remaining 75 percent of the 
students, as compared with the standard set of pfeassessment predictors 
utilized in the IM and WM courses. To answer this question,, the same set 
of discriminant analyses were calculated dri the IM arid WH course data as 
had been calculated with only the SSQUES variables^ For the IM course^ the 
preassessment predictor set consisted of 24 course-specific cognitive^ 
affective, and background information predictors (see Table 11); for the 
MM course, the preassessment predictdr set. consisted of 26 coursp- ^cific 
predictor^ (see Table 13). - - 

The results of the IM course analyses generally :ndica ted that the 
preassessment set correctly classified approximately (a) three percent more 
studerits on the block time criteridrii (b) riirie percerit more students on the 
block score eriteribri; (e) an average of five percerit more studerits dri the 
lesson time criterion; ind (d) a1i average-bf four and aJiaili._petcent rab^^ x 
students on the lesson score criterion, as compared to the questionnaire 
analyses. - . 

The WM course arialyses yielded similar results ^ indieatirig that the :^ 
preassessment set correctly classified approximately (a) 21 percent more 
student^ on the block time criterion; (B) 11 percent more students oh the 
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■ blbefc score criterion; (c) an average of five percent mdre students on the 
lesson time criterion; and (d) an average of 15 percent more students on 
the lesson score criteridri^ as compared to the questionnaire analyses; 
Thus* the larger preassessment sets were able to correctly classify a 
larger proportion of the students, particularly at the block level in the 
Wfl course. An additional set of discriminant analyses, however^ which 
utilized variables from both the questibririaire and preassessment sets 
indicated thvit for both the IM and WM courses, all five of the SSQUES 
variables were in the set of the most significant predictors of group 
membership for the lesson and block level analyses (as defined by changes 
in the Raos V discriminatidn index). 

Discussion 

The present study had the purpose of evaluating the potential useful- 
ness (reliability, construct and predictive validity) of a new study skills 
measure for (a) predicting student perfdHnance in a self-paced, individual- 
ized, dr cdmputer-managed ihstrtictidnal erivirorimeriti and (b) identifying 
students in heed of some type of study skills remediation. The results 
indicate that the SSQUES and its subscales demonstrated good reliability 
and prelirainanr construct validity. The differential construct validity 
j:ilatid_nsMf^^^ in t he factor analysis^ results for the IH and WM courses 
suggest that^ within different trainee populations, different patterns of 
cbgnitive-ind. affective student characteristics are related to the students* 
ratings of peir study skills in the reading cdmprehensidni memorization^ 
cdncentratidfl m arid test takirig areas. 

-fc^^^^^ to the findings of theoretically neaningful but differential 
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factor enalytic relationships, the data in both courses revealed a 
conceptually distinct study skills factor* indicating sijppart for the con- 
struct validity of the SSQUES. Qf farther relevance is the finding that 
both cognitive arid affective variables tend to be related to variables in 
the study skills domairi, suggesting the need for both cognitive and 
affective remedial strategies in dealing with study skills problans. 
Rutkowski and Domino (1 §75) reached a similar cbriclusiori Wheri examiriirig 
the effeeti^ariess of a cognitive trairiirig program for Iraprovlsig study 
skills^ arid tfiey reconmerided that further efforts to ameliorate study 

skills problems also take personality variables into accourit. 

■ /_ 

With respect to the validity of the SSQUES for pfedietirig studerit 

perfonnarice (times* scores) in the AIS erivirohmeriti it is in^ortarit to riote 

that the degree to vSich the SSQUES variables correlated with subsequent 

student performance did not decrease as a function of time in tlie course 

and, in several cases, actually improved from early to late cbtirse blocks^ 

the strength of the correlations of the study skills variables *rith studerit 

l)er^b»Tnance was"f6wd W be a tiihction of"Botfi~the t^~o?l^ ^ 

variable (time versus score) and the nature of the instructidhal unit (type 

of block or lesson), these cdrrelatiohs were erieduragirig^ however^ in that 

the SSQUES variables were found to account for as nwcfi as 25 to percent 

of the variance in student perfomance* It. is also of Interest tSat 

different patterns of predictor relationships were found for differing 

cHteridh variables ^ suggesting that the SSQUES variables are sensitive 

predlcteYs of both different Icinds of performance criteria and different 

__^x^__ _: __i 

Icinds of course content. These predictive validity findings, then, provide 
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some support for the hypothesis that a cdmbi nation of self-rating items 
and items which ask students to describe their skills are useful in 
effectively predicting student performance. 

The results of the analyses which examined the ability of the SSQUES 
and its subscales to discriminate groups of students who would perform 
poorly versus satisfactorily in the AIS environment indicated that the 
SSQUES variables were consistently able to correctly classify beta^een 60 
and 70 percent of the students. Even though it might be argued that the 
larger preassessment variable set available in the AIS envirbhment was some- 
what mre effective than the SSQUES variables in diseriminatihg poorly 
versus satisfactorily perfbnnihg groups of students, there are a riumber of 
issues raised by these findings. 

First, for those individualized or computer-based ertvirdnmehts which 
do nof support preassessment testing or the use of preeburse student data 
in performance pfedietidns, it may be more efficient to simply implement 
the SSQUES for predictive and diagnostic purposes, rather than designing 
'^a^nd'invlementing some type "(Tfn^jrecbWseirssfes^^ The second 

issue is related to the ihteridid use of the SSQUES in self-paced^ 
individualized or cbnipgter-based eavirbmnents as a prescriptive and/or 
diagnostic tool. On the basis of the present findings, it would appear 
that the questionnaire could at least be used to supplement the pre- 
diction of student performance^ in that it serves a highly useful fuhctibn 
in the diagnosis of particular student study skill weaknesses^ and thus 
facilitates the instructor's remediation decisions. Finally, the short 
length and short administration time (approximately five to 10 minutes) 
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makes this measure attractive for situations where "time is of the 
essence" or the amount of student time available for preeburse testing is 
. limited. 

Tfie reported validity results and cbhclosions are, of course, tentative 
Until substantiated in cross-validation studies. Furthermore, aiiditional 
research on the independent contribution of the two types of items used in 
the SSQOES (comparative self-rating and self^deseriptieh) would be helpful 
in answering measurement questions in the psychometric domain and 
theoretical questions in the individual differences domain. Related to 
further research with the SSQUES is tJie possibility of anhahcihg both the 
reliability and validity of this measure by ihstruetidns to students which 
encourage them to answer all items as truthfully as possible. For exainple, 
BdrnsteTn et al. (1977) report that taking the time to tell students that 
they are independent thinkers, that they are believed to have high integrity 
and to be able to evaluate themselves honestly ^ and that inaccurate report- 
ing of data would result in loss of time* money and energy, has the payoff 
"OTTncreasihg the fidelity of self- reports. 

Conclusions 

The following conclusions can be drawn from the preliminary SSQUES 
validation results: ~ 

(1) A eombihatibh of self- rating and self-description of study skills 
items in areas identified as important in a CMI enviromnent (reading 
comprehension, memorization, test taking* Cdncentratibh managemehtj is both 
a reliable and valid method of assessing areas of student strengths and 
weaknesses. The .fidelity of this neasure might be further enhanced i?y in- 
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cdrporatirig instructions which stress the importance of honest answers. 

(2) The SSQUES in its present fdm has sufficient predictive 
""validity to be of use to instractbr^ in the prediction and/or diagnosis of 

th©se students expected to have difficulty completing thei-r course " 
efficiently and effectively. 

(3) The SSQUES could be u^etl as a reliable diagnostic and/or prescrip- 
tive tool in lieu of the battery of precdurse assessment procedures or as 

a supplement to these procedures. ; 
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Table 1 

The Study Skills Questionnaire (SSQUES) 



Item 



Sub s cale 



1. 



2. 



4. 



7. 



I get deeply involved with material I am studying 
ii.e., I really think about it rather than just 
trying to memorize it). 



REABEH 



a. almost always 

b. most of the time 



c. some of the time 

d. almost never 



\ 



If I am readihg some eourse material and cannot 
understand it^ I keep going anyway in order to 
finish the assignment. 



READeM 



a. almost never 

b. sometimes 



c. frequently 

d. very frequently 



I would rate iri^ability to read and remember 
technical Information as: 



READCM 



a« 
b. 



well above average 
above average 



below average 
well below average 

I would rate ability to take good text notes as: 



c. 
d. 



a. well below average c. above average 

b. below avera[ge d. well above average 

In comparison to the amount of time spent reading 
your notes and the textbooks^ how much time do you 
spend testing yourself V oh the material when studying 
for ah exam? 



READCM 



READCM 



a. a large amount of tlme^ c. 
b^ a moderate amount of time d. 



a snail amount of time 
generally not at all 



8heh you can't understand what you're reading » do you 
try to -figure It but? 



READCM 



a. almost almiys 

b. most of the time 



c. -some of the time 

d. almost never 



You finish reading a Tesson and find that you don't 
remeiid)er what you read. How often does this happen 
to you? 



READCM 



a. almost never 
b^ sometimes 



Ci frequently _ 
d. very frequently 
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8. 



11. 



12. 



13. 



I think It is easy to find the main idea of a 
paragraph or passage. 



a. almost always 
bi most of the time 



c . some 6f^ the t1 me 

d. almost never 



Do you try to find personel meaning in the technical 
material to help you remember it? 



a. almost never 

b. some of the time 

Id. Hy memory for facts is: 

a. well above average 
bi above average 



c. most of the tiire 

d. almost always 



c. below average 

d. well below average 



You have, read some matenal for a lesson ^^a^^ ybU feel 
that you understood pretty inuch irtiat was being said. 
A classmate then asks you a question on the material 
or you try to recall^ some of the material yourself and 
find you can't remember much of what you have read. 
How often does this happen to you? 



a. very frequently 

b. frequently 



Co sometimes 
d. almost never 



When It's necessary for you to memorize material , 
how much time do you spend memorizing it? 



MEMORY 



HEH8RY 



HEW0RY 



MEMORY 



a. itiore than 1/2 my study 
tirse _ 

bi 1/2 of i^y study time 



Ci 



d^ 



1/4 to 1/2 of my study 
time 

1 don't memorize material 



To memorize something * I repeat it to n|yself many 
times. 



MEMORY 



14, 



15. 



a. 
b. 



almost never 
sometimes 



frequently 
very frequently 

To membr*1ze something^ I wr*ite it dovm several times. 



c; 
d. 



a. very frequently 

b. frequently 



c. sometimes 

d. almost never 



How would you j-ate your ability to memorize and 
reroen^er information? 



a. well above average 
b^ above average 



c. below average 

d. well below average 



MEMORY 



MEfWRY 
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Table 1 (Continued) 



16i I would rate my ability to do well on multiple 
choice tests as: 

a. well above average c. below average 

b. above average d. well below average 

17. I usually read the test directions very carefully. 



21. 



TSTTAK 



22. 



TSTTAK 



23. 



a. very frequently 

b. frequently 



c« sometimes 
d. -almost never 



18. I would, rate my ability to finish tests oh time as: TSTTAK 



a. well below average 

b. below average 

19. You are taking a test 
which you are sure ydU 
cah*t quite remember it. 

a. almost never 

b. sometimes 



c. above averag^ 

d. well above average 

you come to a question for 
the answer, but you just 
How often does this happen? 

c. frequently 

d. very frequently 



TSTTAK 



20. Rheh :takihg ah exam^ I am usually feeling 



a. very relaxed 

b. relatively relaxed 



c. somewhat nervous and 

d. very nervous and upti 



You study very hard and you know that you understand 
the material but whea-you set down to take the test, 
you forget everything you knew. How often does this 
happen to you? 



TSTTAK 

uptight 
ght 

TSTTAK 



a. almost never 

b. sometimes ^ 



c. frequently 

di very frequently 



I would rate njy ability to concentrate (compared to 
other students) as: 



CONMGT 



a. infell above average 

b. above average 



Ci below average 
d. well below average 



i would fate my ability to deal with distractions 
that occur while I*m studying as: 



eeNHGT 



ai wel 1 below average 
b. below average 



c. above average 

d. well above average 
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Table 1 (Coritiriuedj 



SubscaTe 



24. 



26. 



30. 



I would rate ability to keep my feelings and 
emotions from interfering with my school work as: 

a. well below average c. above average 

b. below average d. well above average 

I would rate ability to deal with distractions 
that occur while Tm taking a test as: 



b. 



c. 

d. 



below average 
well below average 



well above average 
above average 

Once . I get started^ i find it easy to continue 
studying for a relatively long time. 



a. almost always 

b. most of the time 



c. some of the time 

d. almost never 



am studying. 

a. almost never 
b* some of the time 



c. rrost of the time 
di almost always 



•28. You are studying a lesson. After reading a number of 
paragraphs, you suddenly realize you have ho idea 
what you just read because you have been thinking of 
* other things. How often does that happen to you? 



ai very frequently 
b. frequently 



c. sometimes 

d. almost never 



29. I get sleepy when I start to study; 



a-5 
b. 



almost never 
sometimes 



c. frequently 

d. very frequently 

If other students are studying near me^ I 
trouble blocking out noise in the room. 



a. alnost never " 

b. sometimes 



c. frequently 

d. very frequently 



eoriHGT 



COriHGT 



conHgt 



27. I enjoy studying. I am usually in a good mood when I CONMGT 



COilMGT 



edNMGT 



eONM6T 
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table 2 

fteahs. Standard Deviations i and Alpha Reliabilities 
of Study Skills Questidrihaire Total Scale and 
Subscales Administered in Four AIS eourses 



Course 


Scale 


Score Range 


N 


Mean 


SD 


Alpha 




IK 


SSQUES 


30 - 120 


313 


81.0 


17.5 


.75 






READCH 


8-32 


313 


22.9 


5.T 


.87 






HEHSRY 


7-28 


313 


17.3 


4.1 


.73 






TSTTAK 


6-24 


313 


16.6 . 


4.0 


*32 








9-36 


313 


24.1 


6.1 


i88 




HF 


SSQUES 


30 - 120 


92 


81.7 


16.1 


.94 






REAeeM 


8-32 


92 


23.2 


4.5 


,82 






MEMORY 


7-28 


92 


16.7 


4.0 


.75 






TSTTAK 


6 - 24 


92 


16.5 


4.0 


,m 






bOHMGT 


9-36 


92 


25.3 


5.8 


.88 




PHE 


SSQUES 


3d - 120 


79 


82.6 


13.7 


.91 






READCM 


8-32 


79 


23.2 


4.2 


.80 






PEHORY 


7-28 


: 79 


18.0 


3.5~ 


.55 






TSTTAK 


6-24 


79 


16.8 


3.2 


.75 






CONMGT 


9-36 


79 


24.6 


5.1 


.84 






SSQUES 


30 - 120 


297 


85.1 


9.3 


.81 






REABBM 


8-32 


297 


24.1 


2.3 


.58 






MEMORY 


7-23 


297 


13.2 


2.5 


.35 






TSTTAK 


6-24 


297 


la.o 


2.2 


.48. : 






eONRSf 


9 - 36 . 


297 


24.9 


5.4 


.82 
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TABbE 3 

Hearts^ Standard Beviations, and Iteiii-iteroainder 

Gorrelations forStud^ Skills Questionnaire 
Total Scale and Subscales in IM Course (N=313) 



Subscale/Item 


Mean 


SD 


Item Remainder 










Total 


Stibseale 


REAOCN 


1 


2 72 






6S 




2 


3.05 


1.04 




48 




3 


2.71 


.74 


.77 


70 




4 


2.69 


.80 


.67 


63 




5 


2.91 


.91 


.59 


.58 




6 


3.32 


.93 


.68 


.68' 




/ 


2.77 


.89 


.71 


i60 




8 


2.77 


89 


i69 


66 


MEMORY 


9 


2.60 


1.03 


.49' 


.35 




IB 


2.41 


178 


.69 


.58 




11 


2^86 


.86 


.73 


.63 




12 


2.05 


.99 


.33 


.26 ' 




73 


2.05 


.95 


.38 


.40 




14 


2.63 


1.14 


.39 


i39 




15 


2.70 


.75 


.79 


i63 


tsttAk 


16 


2i82 


, 

i78 


.73 


.71 




17 


3.15 


.98 


.61 


.51 




18 


2.59 


1.02 


.43 


.37 




19 


2.65 


.83 


.69 


.66 




20 


2.32 


.86 


.65 


.64 




21 


3.10 


1.05 


.69 


.65 


CONMGT 


22 


2.67 


.79 


.77 


.71 




23 


2.43 


;84 


.59 


.70 




ki 


2.69 


;9g 


^60 


.60 




25 


2.69 


.90 


.66 


.67 




26 


2.68 


.96 


.63 


.60 




27 


2.48 


.89 


.62 


.62 




28 


2.69 


.94 


.73 


.70 




29 


2.94 


1.03 


.59 


.57 




30 


2.86 


1.11 


.55 


.60 
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TABLE 4 



fteans , Standard Deyiations * and Item-Reniairider 
Correlations for Study Skills Questibrinaire 
Total Scale and Subseales in HF eburse (N=92) 



REABeM 



fCMORY 



TSTTAK 



eONMGT 



o 

ERIC 



Subscale/Item Mean SB Item Remainder 





- - 




Total 


^ubscal e 


1 


2.72 


.86 . 


.60 


.57 


2 


3.14 


1.03 


.53 


" .51 


3 


2.61 


.66 


.66 


.57 


4 


2.86 


.79 


.58 


.55 


5 


2.83 


.8a 


.52 


.51 


6 


3.30 


.92 


.60 


.55 


/ 


o on 


.84 


.72 


.55 


8 


2.91 


.85 


.58 


.52 


9 


2.53 


.93 


.54 


.24 


10 


2.34 


.86 


.62 


.55 


n 


2.86 


.76 


.74 


.65 


12 


1.93 


.97 


•3i 


.33 


13 


1.97 


.88 


.47 


.60 


14 


2.46 


1.13 


.31 


-.39 


15 


2.60 


.80 


.71 


.61 


16 


2.84 


.77 


.73 


.71 


17 


3.11 


.92 


.60 


.49 


18 


2. IT 


.93 


.52 


.45 


19 


2.60 


.77 


.69 


.72 


20 


2.25 


.83 


.68 


.66 


21 


2.91 


1.88 


.65 


.70 , 


22 


2.79 


.76 


.69 


.72 


23 


2.64 


.90 


.61 


.64 


24 


2.84 


Ji 


.65 


• .65 


25 


2.84 


i83 


.65 


.66 


25 


2.76 


;97 


.56 


.65 


27 • 


2.58 


.91 


.52 


.50 


28 


2.67 


.88 


.65 


.58 


29 


3.05 


.95 


.59 


,66 


3d 


3.15 


.96 


.64 


.61 
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TABLE 5 



Means; Standard Deviations^ and itersHRemaindef 
Correlations for Study Skills Questionnaire 
total Scale and Subscales in PHE Course (S=79) 







ncan 




Item Remainder 










: 


Total 


Subscale 




REAeCfl 


1 


2.84 


.75 


.51 


.53 






2 


3.20 


,88 


.58 


.51 








Cm /U 


. 77 


.65 


.57 






A 
•r 


9 77 

Cm / i 


7*? 


.60 


.50 






o 


0 AC 


.yy 


.40 


i38 






D 


V* ^? 


7C 


i67 


.65 






7 


t,ml6 


i73 


.60 


.49 






8 


2.91 


«77 


.63 


.57 




BpMApV 


Q 


O Oil 


1 «04 


.48 


.35 






1 W 






.49 


. 51 






i 1 
1 1 




7C 


.58 


.45 






J 4 


1 


1 mC& 


.20 


^06 






1 Q 

J4 




- i97 


i28 


.03 










1 .U 1 


.28 


.24 






1 3 


£•01 


-SO 


i 62 


.57 






16 


£•01 


• DC 


.61 


.56 






17 


3.28 


.88 


.59 


.48 






18 


2.65 


.82 


.28 


.25 






19 


2.82 


.66 


.58 


.56 






20 


2.18 


.78 


.49 


i5B 






21 


3.19 


1.00 


.61 


.67 




CQSHST 


22 


2.77 


.62 


.77 


.71 






22 


2.58 


.71 


.63 


.59 






24 


2.72 


.89 


.44 


.33 






25 


2.70 


.74 


.60 


.Si 






26 


2.70 


.91 


.61 








27 


2.47 


.92 


.56 


i57 






28 


2.68 


i84 


i71 


i64 






29 


3.05 


.86 


.63 


.60 






35 


2.91 


1.12 


.48 


.52 
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TABLE 6 

Means, StandartJ beviatidhSj and Item-Rimainder 
Correlations for Study Skills Questionnaire 
Total Seale and Subscales in HH ebdrse (PI=297) 



Subseale/Iteiii 


Heah- 


SD 


Item Remainder 










Total 


Subscali 


REABCM 


1 

1 


3.00 


.69 








2 


3.35 


.73 


19 


23 




3 


2.80 


.56 


38 


29 




4 


2.68 


=^.67 


28 






5 


2.83 


.70 


17 


15 




6 


3.44 


.69 


.22 


.26 




7 


3.05 


.70 


.50 


.29 ' 




8 


2.93 


./4 


44 






9 


2.60 


.88 


22 


- 01 • 




lb 


2.49 


.71 




33 




11 

1 1 


3.05 


' .65 


62 


30 




12 


2.21 


.90 


14 
• i*t 


07 




13 


2*12 


.86 




1=5 




14 


2*81 


. .98 




05 




15 


2i87 


.52 


45 


37 


TSTTAK 


16 


3.04 


.53 


.30 


.27 




17 


3.21 


.74 


.32 - 


".16 




18 


2.77 


.86 


. -.06 


-.04 




19 


2.9Q 


.57 


.53 


.44 




2B 


2.57 


.72 


.47 


.35 




21 


3.38 


.75 


.55 


.44 : 


eONMGT 


22 


2.88 


.58 


.36 


.18 




23 


2.71 


.77 • 


.54 


.62 




24 


2.89. 


.78 


.47 


.53 




25 


2.89 


.77 


.51 


.60 




26 


2.65 


*90 . 


.59 


.62 




27 


2.46 


i9l 


i56 


.57 




28 


2.85 


.83 


.57 


.56 




29 


2.76 


1.27 


.42 


.54 




30 


2.80 


1.32 


.48 ; 


.60 
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TABLE 7 



Intercorrelatlons of Iriitial Measure of Study Skills 
Questionnaire Variables in IH Course (fi=267j 



REABCM 



MEMORY 



TSTTAK 



CONHGT 



SSgUES 



READCM 


1.00 & 


.43 


.55 


.77 




MEMORY 


1 .00 


.39 


.26 


.65 




TSTTAK 




1.00 


.41 


.72 




eONMGT 




\' 


1.00 


.77 


r 


SSQUES 






♦ 


1.00 



All above correlations am^significant at the p < ^001 level. 
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TABLE 8 

ihtercdrreUtidns of Initial Measure of Study 
Skills questionnaire Variables in MF Course (N=90) 





REAeeM 


MEMORY 


TSTTAR 


GONMGT 


SSQUES 


REAOCH : 


1.00 


.40 


.48 


.50 


.76 


MEMORY 




1.00 


.61 , 


.37 


.78 


f STTAK 






1.00 


.41 


.77 - 


eOfiMST 








1.00 


•72 


SSQUES 










1.00 - 
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TABbE 9 

Ihtercbrrelations of Initial Measdre of Study Skill?' 
QuestibnnaTre Variables in PME Course (N=8d) 







HEM0RY 


TSTTAK 


C0NM6T 


SSQUES 


REAOCN 


1.00 


.47 


.38 


.67 


.84 


HEH0RY 




1.00 


.23* 


.44 


.64 


TSTTAR 






1.00 


.46 " 


.64 


CdNMGT 








1.-0Q 


\ .88 


SSQUES 


i 








1.00 



* p< .05; all other correlations are significant at the p < .001 level. 
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TABtE 19 

iritereorrelatibns of Initial Measure of Study Skills 
Questionnaire Variables in WM Course (N=271) 





REASCM 


MEMORY 


tsrfAK 


CONMGT 


SSQUES 


READCH 


1.00 


.38 


.48 


i48 


.78 


HEH9RY 




i.oa 


•41 




.62 


TSHAK 






1.00 


.39 


.71 


CdNMGT 








1.60 


.81 


SSQUES 










i.od 



* p <: .01; all other correlations are significant at the p< .001 level. 



do 



Tictdf 



.TaEll: 



of IS Preassesswnt Testing Battery 
Tistilescrlptlons ~" 



Reading/ - LoiicaL Reasoning Test 
' " : (L06REA) 



Reading/ IN Reading Skills Scale 
teasoning Reading Scale 1 (REA^l) 

2 



Hedia 
Preference 

Hedia 
Experience 



Reasoning (RiETt) 



Test 



Attitude Tward Coyrse 
Natenals 

State Anxiety (STANXj 
State Curiosity (STCURj 



Anxiety Jest Attitude Inyentonf 



Test.ifony (TAMj 
Test EBBtionality (TAIEH) 
Test Anxiety (TAIEX) 

general Attitude Scale 
Trait Anxiety (TRANX) 
Trait Curiosity (TRCUR) 



General Hedia Preference 



Visual (PREFV) 
Audio (PREFA) 
Print (PREFP) 
Conventional 
Self-PaceyEXPSP) 



student'lgeneral ability 
tpjudge 'tiie ipgical soundness of 
neaningful conclusions* 

fesures jtudent's technical infor- 
mation proKSsing and retention 
skills, under tiosd condltionsi 
on materials extracted from IN and 
NF technical liiahuajsi 

Heasures student's coniprehensloni 
under tiiied conditions i of terms 
frequently used in Air Force 
ddciients and manuals, 

Heasures hoi tense or apprehensive 
versus.interested orjotivated a _.. 
student feels about jearhing the IN 
course materials on an intensity 



Heasures, on a fresjuence dimensidni 
student's tendency td.feel cognitive 
worry yersiis ijotioiiaj versus 
generally anxibiis wiieli talcing per- 
fonnance of-achievanent tests. 

Heasures student's general tendency 
to experience feelings of tension 
and apprehension in situations per- 
ceived as threatening versus feelings 
of interest iii a variety of technical 
areas. 

Heasures student's preference for 
visual versus audio versus printed 
learning materials, as Nell as his/ 
her experience Nlth conventional 
versus self-paced instructioral' 
methods 



5(1955) 

HcCombs (Note 1) 



Deignan (Note 2) 



Spielberger* 

Go«iiehS____ 
bushehe (1979); 
HcCorats-teherissey 
[Notes] 

Spielber^er (Note 4) 



Spielberger et al. 
(1970); Day (Note 5) 



HcCombs (Note 6) 



ft 
e 



O - 
> 

fit 
(A 

3 

3- ' 



0^9 

ERIC 



TABLE 12 



Variiax. Rotated Factor Hatnx;for IH Course Study Skjjls 
Questionnaire and Preassessnent Variables (H « 213) 



HiABlES 


FACTOR V 
(Anxiety) 


mrni 


FOR 3 
h-j^moy oKiiis| 


FACTOR 4 - 
(Cunosvty) 


- FACTORS 

1 n~ " J » " M "i 

(Hedia Experienct 


FACTOR 6 

(Media 
N Preference) 




- 186 






.240 


.224 


-.086 .. 


NEH9R! 

* <WI will 


- 118 


1711 

.1/0 


.489 


-.033 


: -.009 


-.035 


TSTTAK 


- 469 


IIS 


.480 


-.101 


.052 


-.046 


CONNGT 


- 303 


•UUI 


^33 


.177 


.099 


-.141 


SS8UES 


- 341 






.101 


.116 


-.198 


READS] 


-.068 






Ann 

.090 


.125 


.013 


READS2 . 


- 132 




.084 • 


.141 


.979 


-.178 


RV0CTL 


• 191 




il48 


.004 


.106 


.019 


LOGREA 






If 1 

.141 


nil 

.933 


;036 


.091 


STM 




-.-139 
••loo 


-.236 


-.310 


-.913 


.148 




- lid 


noi 


1 '/in 

il46 




.062 


-.202^ 


TRANI 




••loo 


-.2/4 


-.372 


" -.015 


,085 


TRCUR 




ill? 


.036 


.649 


.101 


.039 


TAITI 




-.lOo 


-.201 


-.058 


-.038 


.094 


intilT 




1C1 


-.252 


-.043 


-.017 


.084 


tftTPM 


RQl 
•03 1 


-.lux 


-.153 


— A^A 

-.052 


-.040 


.064 


TATFY 


filA 


010 


-.186 


-.126 


-.045 


.159 


DCCCi 
rKtrfl 


161 

• lol 


-.003 


-.056 


.165 


-.072 


M 


PREFy 


.068 


■ .907 , ' 


-.058 


-.089 


.137 


M ; 


PREFP 


%032 


'.005 


.111 


-.322 


.090 


-J7 


EXPCI 


-.664 


.213 


.100 


.117 


M 


.058 


EXPSP 


-.007 


.110 ' 


.109 


.OSS 


.760 , . 


-.025 



ft 
c 



> 

fit 
(/I 

IQ 
(A 
0 

3 

(D 
3 
ft 




TABLE 13: Oescriptien 

^actop Test aiid Subseale 

« feding Skills Scale 
Reasoninf Re&ling Scale 1 (READSl) 
Reading Scaled 

Reading Vocabulafy Test 
Reasoning (RVOCTL) 

•HathSkiiis Ship DestiriaW Test 
(SHIPDS) 

. Hath Skills ftetii Faiaiiiarization 
(HATHFT) . 
Scale l(flSTHn) 
Scale 2 (MATHF2) . 

Anxiety ' Attitude Tward 
Curiosity Baterials 

. State Anxiety 
State euriosity 

Anxiety ISneral Attitude Scale 
i Trait 'Anxiety (TRANX) 

Trait euriosity [TRCUR) 



of Hfl eourse Preassessment' Testing Battery 



student's reading compre- 
and speed on iiiaterials 
extracted from HH technical orders 
and technical manuals. 



(Notel) 



a student's "cbinprehensioni 
under timed conditions! of tetnis 
freguently used in Air Force docu- 
ment and manuals. 



Heasures student's peral arithltic 
reasoning or problan solving ability, 
using specific rules to solve 
preblems under timed conditions. 

Heasures student^ basic Jlth 
skills, under timed conditions, on 
easy and difficult subseales, that 
are required in certain areas of, 
thelHcour^ei 

Heasures how tense or apprehensive 
versusjnterested or motivated a 
student feels about leaming the 
WM course materials on an intensity 



Measures, on a frequency diiiiensi on/ 
student's generaj tendehey to ex- 
. of tension and 
lii si tuatibiis perceived 
as threatening versus fe^ ings of 
Interest in a variety of technical 
areas. 



Oe:gnan [Note 2) 



Ohristensen I MM 
(1955) 



ATD-Develbped 



Spielberger, Gorsuch 
& tushane []97(j); 
HcCois-Leherissey (Note 3) 



Spielberger et al. 
(1970); Day (Note 5) 



ipt 

(A 

K 

«4i 



K) - 
6 



a. 
ft 
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TABLE 13 (Cdhtintjed)- 



WOP -Test and Sybscale Hals • Test Bescaptlm- 



Epriosity Hechanical Curiosity Scale 



Test- Attitude Inventory' 
(TAITL) - 
Test Horry (TAiHY) 
Test Emotionality (TAIEHj 
Test Anxiety (TAIEXj 



Media Pref- General ftedia Preference 
arence Scale 

fisuai (PREFV) 

ftydid(PREFA) 

Print (PREFP) 
Hedia Exper- eonventional (EXPCI 
lence Self-Paced (EXPSPj 



Heasures. student's general feel- 
ings df.interest, or tendency to 
become interested in, mechanical 
devices and ichanical principles. 

Measures, on a frequency dimension, 
student's tendency to. feel cognitive 
worry versus eirotionaj yersus 
generally anxious when taking per- 
foriiiance or achievement tests. 

Heasures student's preference for 
visual versus audio versos printed 
learning modes, as well as his/her 
expeHence with conventional 
versus sel f-paced i nstructional 
methods. 



Author Unknown 



Spiel berger (Hdte 4) 



HcCombs [Mote .6) 



TABLE 14 



VariBiax^^ited Faetor HatHx for i Course Study Skills 
iluestlonnlire and Preassessment Variables (N * 271) 



FACTOR 1. 



mm 
mm 

^TSHAK 

mm 

SSQUES 
READSl 
REA1K2 

Rvom 

SHIPDS 
STANX 



flECCUR 
^^ PREFV 



'HftTHFl\ 

NATHF2 

STHFT 

TAiwy 

TAIEH 
TAiEX 

fAITt 

erIc 



-.202 


M 


.063 


-.208 


M. 


.025 


-.483 


M 


•.093 


.-.167 


M 


.08? 


-.303 


M 


.088 


-.288 


.073 


104 


-.062 


-.049 




-.216 


.127 


173 


-.143 


.051 


.330 


M 


-.251 : 


- 134 


-.250 


.215 

• ■•1 w 


dig 


-.009 


.124 


- 017 


.137 


-.036 


-.002 


. .146 


.147 


i-.847 


-.863 : 


.124 , 


-.023 


.008 


.061 


• 007 


-.061 


.002 


.976 


;036 


,059 


.511 


-.150 
-.109 


.047 


M 


.058 . 


M 


M 


-.232 


■ -.054 


M 


-.164 


-.008 


M 


-i217 


-,128 


M 


-.205 


-.052 



taUR 3 FACTOR 4 
(math (Hedia 
Skills) Pref 



-.121 

.218 
-.023 
-.456 
-.206 
-.075 
-.001 
-.061 
.070 
, .039 
-.003 
.049 
^482 
M 
-J8Z 
.066 
.080 
.035 
-.073 
-.044 
.155 
.135 
.127 
.150 



FACTOR 5 
jriosit^ 

.238 

-.010 

.060 

.215 

.171 

.015 

.075' 
-.029 
-.020 
-.398 

M, 

M 

.154 

.034 

.094 

.146 

.100 
. -.003 

.025 

.025 
-.098 
-.031 
-.048 
-.059 



FACTOR 6. 
(Reading/ 
Reason 

.050 

.090 

.095 

-.069 

.032 

055 

M 

M 

M 
-.048 

.166' 
-.054 
-.052 
-.319 
-.036 

.159 

.115 

.140 

.149 

.164 
-.143 . 
-.123 
-.132 
%136 



FACTOR 7 
[Hedia_ . 
Fience) 

.055 

-.039 

.064 

;e56 

.047 

.072 

.088 

.099 

.047 

-.154 

.064 

.197 

.044 

.040 

-.073 - 

M 

M 
-.049 ■ 

.109 

.061 
-.008 

.051 
-.069 

.003 



& 
c 



> 
V) 

9 

V) 
VI 

3 

3 
It 



§5 
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TABtE 15 



Multiple Stepwise Regression Results for IM and HF 
eburse Total Completion time and Score Variables 



Course/ Predictor Increase 

Criterioh Viriables N Total R^ yariablpf in R^ 

IH Course (Blbclcs 2>6) 

Cbnipletibn Time 88 . 40 MEMORY .34 

CONHGT .06 

Sura of Block Scores 105 .14 REABCH ,09 

TSTTAK , .03 

eONMGT .02 

ME^^e (Blocks 2-5) 

Completion Time 50 .15 JCHORY .15 

Sum T5f Block Scores 70 .26 fSTTAK .21 

REABEH .05 



• 53 

ERIC 
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TABLE 16 ■• 

fteltiple Stepwise Regression Results for the IH and HF 
Coarse Individual Block Completidh Time and Score Variables 



Course/ ~ Total Predictor ^2 ~ 

eriterioR Varia b les -N R^ yariables Increase 

IH Course 



Block 2 Time (BETA02), 


ie4 


.35 


SSQUES 


.30 










.05 


Block 3 Time (BETAOS) 


104 


. b7 












HEneR? 


.92 


Blocic 4 Time fBETAd4) 


iQl 


. 1 o 












CONHGT 


.03 


Bibeic 5 Time fBETADS) 


163 


28 


mfmIry 












.UD 


__ _ _ — 

Block 6 Time (BETAeS) 


96 


.21 


ssgUES 


.16 








READCM 


.03 








TSTTAK 


.02 


Block 2 Score (BSCR92} 


195 


. .04 


MEMORY 


.04 


Block 3 Score (BSCR03) 


105 


.13 


TSTTAK 


.10 








REAOCM 


.03 


Block. 4 Score (BSCRd4) 


105 


.06 


TSTTAK ■ 


.02 








eesHGT • 


.02 








READCM 


.02 


Block S Score (BSCROS) 


105 


.10 


SSQUES 


.08 








CONHGT 


.02 


Block 6 Score (BSCR06} 


105 


.09 


READCM 


.05 








CONHGT 


.02 








TSTTAK 


.02 



HF Efiwirse 



Block 2 Time (BETA02) 


69 


i07 


CONHGT 


.07 


Block 3 Ti^ (BETAd3| 


63 


.14 


MEMORY 


ai 








TSTTAK 


.03 


Block 4 Time (BETA04} 


64 


.09 


TSTTAK 


.09 


Block 5 Time (BETA05) 


59 


.03 


MEMORY 


.03 


Block 2 Score CBSCR02} 


70 


.13 


TSTTAK 


.13 


Block 3 Score (BSCR03} 


71 


.26 


TSTTAK 


.16 








READCM 


.04 








CONHGT 


.06 


Block 4 Score (BSCRd4} 


71 


•21 


TSTTAK 


.16 








READCM 


.C5 


Block 5 Score (BSCR05} 


71 


.08 


READCM 


M 
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TABbE 17 



Multiple Stepwise Regression Results for the WM 
Course Individual Block eompletlon TTrae and Score Variables 







Total 


Predictor 


r2 


Criterion Variables 


ft 


r2 


Variables 


— Increase 


Block Tlioes 










Block 2 Time (BETAd2) 


46 




None Sig. 




Block 3 Tine (BETAS3} 


46 


.04 


TSTTAK 


.04 ^ 


Block 4 time (BEtA04} 


46 


.03 


_ CONMGT 


t03 


Block S Time (BETAOS) 


42 


'.04 


READCM 


.04 


Block ;5 Time (BETAOe) 


44 




None Sig. 




Block 7 time (BETAO?) ' 

(-—3 


43 


il2 


: eONMGT 


.12 


Block 8 Time (BETAOS) 


44 


.08 


CONHGT 


.08 


Block 9 Tlffl^ (BETA09} 


33- 




^ None Sig. 




i Block 10 Time (BETAIO) 


44 




None Sig^ 




Block 11 time (BETAli) 


46 


.13 


READCH , 
TSTTAK ^ 


.09 
.04 


Block 12 Time (BETA12} 

■ 


46 


.18 


CbNMGT 
TSTTAK 

HEHuKT 


.11 
.04 
• 03 


oiocR lime (I't^'Aioj 


4o 


n'T 
.11/ 




• 0/ 


Block 14 Time (BETA14) 


42 


.11 


eQNMST 


O05 

' fie 
• UO 


HOCK ocores 










Block 2 Score (BSCR02} 


46 




None Sig. 




Block 3 Score (BSCRd3} 


46 


.18\ 


MEMORY 
READCFfe 


•09 
.09 


Block 4 Score (BSe^4} 


46 


.05 


MEMORY 


.05 


Block 5 Score (BSCR05) 


45 




None Sig. 


• * 


Block 6 Score (BSCR06) 
Block 7 score (BSCR07} 


46 
45 


.06 


CONMGT 
None Sig. 


•06 


Block 8 Score (BSCR08) 


46 




None Sig. 




Block 9 Score (BSeR09} 


46 


.19 


eONMSf 
TSTTAK 
READCM 


.07 
.05 
.07 


Block 10 Score (BSeRlO) 


46 


.17 = 


MEMORY ' 


.17 


Block 11 Scorr (BSCR11) 


46 


.13 


CONHGT 


.13 


Block 12 Score (BSCR12} 


46 




None S1.g. 




Block 13 Score (BSeR13) 


46 


-IS. 

5d 


HEBQBY 
SSQUES 


.06 
.10 
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TABLE 18 - 
IM Course piscHminant Analysis Results for Block bevel Data 



^ V*^ ^ AW>^ Art 


, Bbtteun 25% 






r .. 


{ i6 tprrect i y 


Urder ot 


wam ctP Ic5 




N Cutoff 


-{ ft- — 


2 

J — A 


1 ciasSiTieq — 


■ rredictors 


Block 2 


lo// 


0/ 


1877 


292 


1 35.4** 


1 68.4% 


MEMORY 


iinie \iu. 






i • 










ml n uXco J 






1 






■ 










1 




■ : 




LUnna 1 
















TSTTAK 


dJOCK 


lo/o 


JO 
it 


lo/o 






o4.4* 


MEMoRT 
















ccrii ice 
SSQUcS 


mi no ucS J 






i 

j 
























KcADtW 
















lol 1 An 


Block 4 


1154 


71 


1154 


211 


14.5** 


61.3% 


CONMGT 


Time (in 










1 


1 


MEMORY 


minutes) 










j 




READCM 












i 


j 

■ 1 


TSTTAK 


Block 5 


1733 i 


74 


1733 


221 


46.4** 


69.8% 1 


SSQUES 


Time (in 


i 










t 


MEMORY 


minutes) 


) 










} 
j 


READCM 




1 




i 






I 


COBHGT 




^ ! 




J 








TSTTAK 



Block 2^5 6545 61 6545 181 30.6** 



Time (in 
ninutes) 



67.8% 



I gEMORY 
SSQUES 
i CONHGT 
; READCM 
TSTTAK 



Block 2 
Failures 

Block 3 
Failures 



■ 45 



70 



168 



5.8* i 



58.2% 



158 ; 12.8**; 61.8% 



CONMGT 
TSTTAk 
I SSqUES 

1 TSHAK 
i SSQUES 



Block 2 
Score 



Slock 5 
Score ■ 



73 79 



73 



221 : 20.3** 



63.0% 



69 



60 : ;69- 



, 



240 r 24.7»» 



64.3% 



! SSQUES 
MEMORY 
READCM 
eONMST 
TSTTAK 

BEMQRY 
SSQUES 
TSTTAK 
CONMST 
READCM 



Block 2-5 
Score 



* P <f .01 



296 74 296 . 224 i 27.2** 



65.1% 



"TSTTAK 
-SSQUES 
MEMORY 
CdNMGT 
READCM 



p < .001 
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tABLE 19 

IM Course Discriminant Analysis Results for tessbn Level Data 



Eriteridn Bottom 
Variables Cutoff i N 



Cutoff 



2 Correctly Order of 
Classified Predi ctd rs 



Block 2 / 

Lesson 1732 55 ; 1732 164 11.9* 
Tiine ' ■ ' 



Lesson 
Score 



579 55 ' 579 



172 13.6** 



61.22 



64.32 



TSHAK 
SSQUES 
MEMORY 
CONMGT 

TSTTAK 
SSQUES 
CONMGT 
READCM 
MEMORY 



Block 5 



Lesson j 1416 71 1416 209 28.9** 
Time i 



66.1% 



606 70 ' 606 



Score 



217 18.6** 



62.72 



SSQUES 
MEMORY' 
READCM 
CONMGT 
TSTTAK 

CONflGT 
SSQUES 
MEMORY 
TSTTAK 
READCM 



P <.Q1 
p < .001 
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TABLE 20 

HM eoorse Discriminant Analysis Results for Block Level Sata 



Criterion gottgm 25Z i Remaining 75% 
Variables Cutoff I 8 Eutdff N 



Block 2 ?5T 
Time (in 
minutes) 



■■% Correctly | Order of 
C lassifie ds^ Predictors 



381 ?5T 106; 38.0***, TOf 



SSQUES 
COHHGT 
BEAQCM 
TSTTAK 



Block 3 
Time (in 
minutes) 

Block 4 
Time (in 
minutes) 



Block 5 
Time (in, 
minutes) 



Block 6 
Time (in 
minutes) 



583 38 583 



428 36 428 



108: 1.8 

I 



107; 5.1* 



55.52 



59.4%. 



SSQUES 
MEMORY 
READCB 
COHHGT 
TSTTAK 



1603 i 34 



1603 



102 6.6** 



61.0% 



1448 32 



1448 



94 6.2* 



61.1% 



SSQUES 
TSTTAK 
REAOCH 
eONHGT 
HEM0RY 

SSQUES 
TSTTAK 
HEHORY 
eONMGT 
READCM 



Block 7 
Time (in 
minutes) 

Block 8 I 1569 35 
Time (in ! 
iaintites) 



624 i 35 624 106, 2.1 



1569 104 18.7** 



55.0% 



68.3% 



Block 2-^8 
Time (in 
minutes) 



SSQUES 
TSTTAK 
READCM 
MEMORY 
CONMGT 



6496 13 6496 



61 10.6** 



68.9% 



HockT" 
Failures 



Block 8 
Failures 



READCM 
SSQUES 
HEHORY 
TSTTAK 



258 



129 



1^ 36.2*** 



68.3% 



MEMORY 
TSTTAK 
CONMGT 
READCM 



10 26.8*** 71.9% 



READCM 
TSTTAK 
SSQUES 
CONMGT 



ERIC 
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TABLE 20 (Continued) 



Criterion jBottom 23% Remaining 7SS ! ^ 
VlHlblls 'cutoff H Cutoff N 



% Correctly Order 
Classified PredictgjS; 



Block 2 
Score 



72 21 



72 



125 : 2.7 



Block 8 
Score 



71 36 



71 



110 5.4* 



57. 8S gEfiDCH 
; TSTTAK 
MEMORY 
CONMGT 
SSQUES 



59. 6S 



TSTTAK 
SSQUES 
CQNHGT 
READCM 



Block 2-8 
Score 



545 1 3 545 



62 11.2** 



69.31 READCM 
HEHORT 
eONHGT 
SSqtJES 



* p < .95 
** p < .01 
*** p < .001 
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TABLE 21 

WM Course Dlscrimifiant Analysis Results for tessari tevel Data 



Griteribh 
Variables 


•Bottom 25* 




X2 


X Correctly 


Order of 
Predictor 


eatof f N 


Cutoff 


H 


^^Jassified 


Lesson 


1 ■„ i 

j 

422 68 


422 


199 


13.0* 


61.02 


SSqOES ^ 


time 


1 : 










eONHST 




; ■ ' . 










READCM 














Hemory 














TSTTAK 


Lesson 


151 59 


151 


222 


2.6 


54.82 


ssQues 


Score 












BEH8RY 



; eoNMST 

; TSTTAK 
: REAOCH 



Block 8 

Lesson 602 28 602 82 14.6* 

Time 



57.92 TSTTAK 
READCM 
CQNHGT 
BESORf 

ssquES 



68.22 SSQUES 
TSTTAK 
READCM 
eONMST 



Lesson 307 36 307 109 3.7 
Score 



* p < .01 



